Yobulk Perfomance
YoBulk offers an streaming approach for reading a large CSV file in order to improve the time of reading and processing it. YoBulk is self hosted, so the CSV file is imported to the locally hosted Mongo DB.
Benchmarking Setup:
- Apple M1 chip with 8-core CPU & 8GB RAM
- MongoDB version 6.0.1
Upload Speed
Time for file to be uploaded, parsed, and intelligently map column headers for the user to confirm.
| Number of rows | Time taken to Upload |
|---|---|
| 1k | Less than 1 second |
| 10k | Less than 1 second |
| 100k | Less than 1 second |
| 1M | 2 seconds |
| 10M | 4 seconds |
Import Speed
Time taken to go through the different validations for all mapped columns across the entire file and Importing the file into MongoDB
| Number of rows | Time taken to validate and show it in grid view for correction |
|---|---|
| 1k | Less than 1 second |
| 10k | 10 seconds |
| 100k | 50 seconds |
| 1M | 1 Minutes |
| 10M | 3 Minutes |